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AB STB ACT 

I study vas conducted to determine whether the 
Stallings Effective Teaching Practices inservice training program 
contributed to improved teacher performance in the Cincinaati, Dblo, 
Public Schools. The study had tvo major objectives; (1) to assess the 
degree of improvement in selected teacher practices after training; 
and (2) to investigate the post<^ training performance of the teacners 
tfho shotted the greatest need for improvement on the selected 
variables. The research conteit for the study is presented. It 
revietfs the tiork o£ investigators who have examined the CDcrelatioa 
between teaching practices and classroom variables related to 
increased student achievement. A description of the trainiag program 
outlines its intention^ method^ and emphases. Also described are the 
general training conditions^ the observation system^ the selection of 
variables^ and the methods of analysis. Reported findings of the 
studjj indicate that; (1) the average teacher performance ijprovea 
slightly for all teachers on tuenty-five of thirty<^one variables; (2) 
statistically significant improvement was noted for all teachers or. 
nine variables; and (3) on the average, teachers irith the greatest 
need shoned improvement across all selected variables, and 
statistically significant improvement on eighteen of tuentyeigtit 
variables. The report concludes tiitb recomifiendatiDns for further 
research efforts. (APH) 
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IMPt'.OVED TEACHING IN URBAN CLASSROOMS: 
APPLYING MORE PRECISE AjNO DEMANOIfiG STANOAROS 

In 1979-80, the Cincinnati Public Schools pilot-tested the v. "IP* 
approved inservice training program developed by Or. Jane Stallings of 
SRI, International. This training process focused on classroom organi- 
zation, behavior management and "direct instruction" techniques in basic 
skills classes. In the workshops, teachers reviewed specific recommenda- 
tions for improvement, based on research about teaching practices effec- 
tive with low and medium-skilled urban youth. After this review, they 
set personal targets for improvement, based on the expectations communi- 
cated in the training program. Through observation before and after 
training, teachers could identify their current level of use of various 
instructional practices recommended by research. Pre and DOSt observa- 
tions also permitted assessment of teacher change after training to see 
^f teachers had acted on the research recorranendations and improved their 
performance. 

The Stallings Effective Teaching Practices training program was 
chosen for pilot-testing in Cincinna^'i on the basis of its experimental 
t^ack recora of significant teacher improvement and accelerated student 
gains in urban schools. The present study will analyze whether the 
training program contributed to improved teacher performance in urban 
classrooms when it was implemented in a large public school system and 
revised by a second generation of inservice leaders. In particular, two 
objectives will be examined in this study: 



* The Joint Dissemination Review Panel evaluates promising programs for 
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a) to detemnne the degree of improvement in selected 
teacher practices after training; 

b) to investigate the post-training performance of the 
teachers who shewed the greatest need for improve- 
ment on the selected variables. 

The paper v/ill be divided into five parts: 1) The Research Context; 

2) Description of the Training Program; 3) Data Sources and Methods; 

4) Results and Interpretations ^ 5) Recommendations for Further Research. 

The Research Context 

During the last decade^ process-product studies have identified with 
some statistical confidence specific teaching practices and classroom 
variables related to increased student achievement for low and medium 
skilled urban youth.^ The consistency of findings across investiqators has 
permitted steady progress from correlational studies^ to field experiments^ 
to dissemination of successful training models. In this section* a brief 
overview of this line of research will be presented^ with particular 
reference to the developmental work that contributed to the teacher train- 
ing program under study. 

Firsts large scale correlational studies were conducted at the ele- 
mentary level (Stallings and Kaskowitz^ 1974; Soar and Soar* 1972; McDonald 
and CliaSj 1976; Brophy and Evertson* 1976; Good and Grouws* 1977) to 
examine th** actual processes that took place within classrooms and to esti- 
mate their influence upon student outcomes. Tf-e data from these studies 
nrnvi,ied relatively dependable knowledge about relationships between teacher 
behavior and student learning of basic skills in the elementary grades. For 
example, one of the most useful variables to emerge from the research on 
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teaching during the 1970s was student t-ime on task* which could be in- 
Creased by allocating more time to basic skills instruction and by orga- 
nizing the classroom to ensure that students participated continuously 
and successfully in instructional activities found to be correlated with 
achievement. 

Several investigators conducted similar studies on the secondary 
level (StallingSt Needels and Staybrook* 1979; McConnell* 1977; Anderson* 
Evertson and Brophy* 1973). The secondary findings generally supported 
the "direct instruction** model of teaching (Rosenshine, 1979) found to be 
effective at the elementary level* particularly to the extent that basic 
skills mastery by low and medium skilled students was the primary goal 
(Brophy, 1979). In the secondary level studies, the analysis of the time- 
on-task variable was also extended* for example, by separating on-task 
instructional activities into interactive activities (like reading aloud* 
discussion/review, drill and practice which were positively correlated 
with reading gains) and non-interactive activities (like silent reeding 
and written assignments that were neg^itively correlated with reading gains) 
(Stallings* 1980). 

As knowledge about the instructional practices used by effective 
teachers mounted* field experiments were conducted, using the findings 
from earlier correlational work as the ba^is for inservice training 
(Anderson* Evertson and Brophy* 1979; Good and Grouws, 1979; Stallings 
and Hentzell, 1978). Each of these training programs oroduced statisti- 
cally significant change in key teaching practices by treatment teachers. 
The results also favored treatment teachers over control teachers in pro- 
ducing student learning gains on standardized achievement tests. 
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Thus, results from these quasi-experitnents supported previous correUtional 
work and provided stronger evidence of a possible casual linkage between 
Specific classroom variable:; and student learning. 

The present study is a direct outgrowth of the correlational and ex- 
perimental work of Jane Stall ings^ Margaret Needles and their colleagues, 
Stallings et al . identified four phases to their research. In Phase I, 
Correlational Research^ they observed 46 secondary reading classrooms in 
urban c;istricts to examine the relationship between teacher behavior and 
student reading gains. The results of this study provided specific guide- 
lines for efficient instruction that were used in Phase 11* Experimental 
Inservice Training* One-half of the Phase 11 teachers were trained and 
the other half were in a control group that did not receive training until 
the end of the quasi-experiment. The treatment teachers changed behaviors 
in recommended ways, and their students made more reading gain than did 
students in the control group, Jn Phase III* Extended Teacher Training* 
Stallings monitored previously trained teachers as these teachers led 
similar inservice workshops in their own districts. In Phase IV, Dissemi- 
nation Training^ she prepared apprentices to return to their districts and 
function as trainers of classroom observers and as workshop leaders. Since 
one of the authors participated 'n Phase IV of this research^ the current 
study offers an opportunity to critically analyze the effectiveness of a 
nationally recognizea inservice model unde>^ Practical dissemination condi- 
ti ons. 

Description of the Training Program 
The purpose of the training workshops was to familiarize teachers with 
research recommendations related to teaching basic skills to students of 
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varying skill levels. The workshops were also designed as supportive » 
problem-solving sessions where teachers identified individual needs and 
attempted to improve their own teaching performance on specific, observ- 
able variables. If successful* the workshops provided teachers with an 
opportunity to define a more precise and demanding set cf personal stan- 
dards for their own teaching. 

There were five, two-hour workshops held on a weekly basis after 
school for Small groups of five to seven teachers. In >lorkshop I, teachers 
analyzed a report of Stallings* study, '*Teaching Basic Reading Skills in 
Secondary Schools/' In this report, the practices of teachers effective 
with low, medium and high skilled students were summarized. In Workshop II, 
the teachers received a profile of their own teaching practices, based on 
three days* observation of the same class period. The variables reported 
on the individual profile were the same that were studied in Stallings' re- 
search, so that teachers could compare their own level of performance to 
that of teachers who v/ere effective with students of similar skill levels. 
As a result, teachers selected a limited number of teaching behaviors they 
intended to alter. 

The remainder of the training focused on identifying, practicing and 
revising strategies for making these changes in teacher practice. In Work- 
shop III» teachers discussed and learned to implement methods of classroom 
organization designed to increase student time-on-task. In Workshop IV, 
teachers analyzed preventive and motivational techniques for managing stu- 
dent behavior. In Workshop V, teachers reviewed techniques of direct in- 
struction fo'jnd to be effective with poor readers. One to two months after 
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the workshops » teachers were re-observed for three days in the same class. 
Afterwards, they convened for a follow-up workshop in which they received 
and discussed a new individual profile. In shorty the workshop series was 
a self- improvement process for teachers based on research-derived recommen- 
dations and an objective summary of an individual's teaching techniques. 

Data Source and Methods 
The primary data source for the present study are the results of pre 
and post observations of twenty-five teachers who completed the training* 
In this section, we will describe the general training conditions, the 
observation system, the selection of variables, and the methods of analysis. 

Training Conditions 

Six ways that Cincinnati's training conditions diverged from the 
Stall ings model should be noteo. While it should be expected that a model 
will be implemented in different ways, the divergences necessarily affect 
the comparability of results between two versions of the same model. 

First, the Cincinnati Public School district is larger than any dis- 
trict in SRI's Phase II studies, with a higher percentage o^ low-income 
and Black students. Second, the Cincinnati teachers trained were from 
schools that were among the weakest of district schools in achievement, 
attendance and student conduct measures. (It is unknown whether this w5s 
true of classrooms in the SRI sample.) Third, while SRTs training focused 
on secondary reading teachers, 40"^ of the teachers trained i.i Cincinnati 
taught at the elementary level. Fourth, Cincinnati teachers w^re from a 
broad cross-section of subject matter disciplines, including the a"ts and 
EMR Instruction. Fifth, the focus of this study was on changing teacher 
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behavior. No appropriate student achievement data were available or 
collected for this broad range of subjects; no control group of teachers 
was observed- Instead, the relation of the selected teaching variables 
to student achievement was assumed based on previous research. Sixth, 
wfiere SRi teachers were all volunteers, Cincinnati teachers were recruited 
from two groups: those who volunteered after a brief presentation to a 
school staff meeting; and, those who were nominated by assistant principols, 
discipline personnel and department heads as needing assistance with class* 
room organiitation and behavior management. These six divergent conditions 
represent typical ways experimentally developed training programs would be 
altered when implemented in inner^city settings. In part, the significance 
of the present study derives from the evidence of teacher improvement 
despite these divergences. 

Observation System 

The observation system used in this study was initially developed at 
SRI, International in response to a 1969 request by the U.S, Office of Edu* 
cation to evaluate the implementation of educational models in the Follow 
Through program. This system has been modified through time and adaptec 
to the secondary level. In Cincinnati, observers were trained for seven 
days, using the training program developed by SRI. At the completion of 
training, to help decide whether the observers were competent to collect 
data, observers took a criterion videotape 'est for which an 85^ reliability 
rating on each code was used as the standard for mastery. Further* cross- 
validity checks between t>^e two parts of the observation system helped 
establish the validity of the instruments^ In general, observation results 
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have been widely accepted by teachers as accurate throughout the entire 
history of this instrument. 

After being selected for the program^ teachers were observed during 
the same class period on three consecutive days. Every ten minutes, the 
groupings, activities and materials in use in the classroom were recorded 
on the Snapshot instrument. A total of fifteen such observations were 
recorded for each teacher. After each Snapshot, the verbal interactions 
of teachers and students were coded continuously for five minutes. The 
verbal interactions were thus recorded for twenty-five minutes in each of 
the tnree observation periods. In sum, a total of fifteen classroom 
"Snapshots" and approximately goO verbal interactions were used to sum- 
marize teacher behavior before and after training. 

Variable Selection 

To select the teacher behaviors of priority interest, three steps 
were followed. First, twenty general classroom variables found by re- 
search to be significantly correlated with basic skilV achievement were 
identified. Second, a survey containing these priorities was sent to 70 
educators in the Cincinnati Public Schools, including Cabinet mbers. 
Directors, Program Evaluators, Planning and Development specialists. 
Language^ Arts and Mathematics supervisors, Title I and OPPF leadership, 
fifteen principals of inn^r-city schools and ten teachers. Respondents 
were asked to prioritize the ten variables they v/ould most like to see 
basic skills teachers change as a result of inservice training. 

Returns from 35 respondents indicated that five educational priorities 
were rated as the most important outcomes of inservice training for basic 
skills instruction: 
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1) an increase in the amount of positively supportive cor- 
rective feedback motivating students who are struggling 
to learn (Corrective Feedback); 

2) an increase in student learning tine devoted to recom- 
mended instructional activities (Instructional Time on 
Task); 

3) a decrease in teacher/student interactions related to 
discipline or misbehavior (Oiscipline); 

4) a decrease in instructional time spent by teachers and 
students on classroom managenent tasks or school^related 
clerical work (Classroom Management); 

5) an increase in the amount of instruction given to small 
groups* large groups or the total class (Group and Class 
Instruction) . 

Third> specific observation variables reported on the teacher's pro- 
file were selected to specify each educational priority. Table 1 reports 
tne thirty-one classroom variables which were used to assess teacher change 
after training. 



Table 1 



FIVE EDUCATIONAL PRIORITIES AMD RELATED CLASSROOM VARIABLES 



CORRECTIVE FEEDBACK 



INSTRUCTIONAL TIME ON TASK 



OISCIPLI.*JE 



Acknowledgement of 



Student Reading Aloud 
Time Reading Aloud 
Time on Instruction 
Subject Matter Instruction 
All Interactions* Subject 
Written Assignments 
Practice Drill 
Test Taking 



Time on Social 



Correct Answers 
Pral se and Support 
Probing Questions 
Providing Hints 



Interaction 
Students Uninvoived 
All Interactions. 



Behavior 
Negative Interactions 
Social Comments 
Teacher Monitoring 




Positive Interactions 
Student Ooesn^t Know, 
Adult Probes 



Movement 



CLASSROOM MANAGEMEMT 



GROUP AND CLASS K^STRUClIOfl 



Time on Class Management 
Time on Assignments 
All Interactions^ Assignnent 
Class Management Interactions 
Teacher-Controlled Interactions 
Student Remarks* Assignment 



Adult to Group* Total 
Adult to Class* Total 
Group Instruction (Subject) 
Class Instruction (Subject) 
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Data Analysis 

For the two objectives^ a paired t-test analysis of statistical sig- 
nificance was used to estimate the strength and direction of teacner change 
on the thirty-one variables. Since correlational evidence was clear that 
teachers should either increase or reduce their behavior for each of these 
variables^ a one-tail probability test was used* Thus» for objective one, 
the average change in the recommended direction across all teachers was 
assessed on all variables. 

The second objective examined the performance of teachers with the 
greatest need for improvement on each variable. A cut-off point of more 
than 0.5 standard deviations away from Sell's recommended level for each 
variable was used to identify these teachers. For example, if research 
recommended that a teacher be above the mean isi perforaance on a soecific 
variable, all teachers who were 0.5 standard deviations or more below the 
mean were identified as having the greatest need for improvement on that 
variable. In this way, cut-off points were selected to eliminate with 
confidence those adequately performing on the variable. (A sample pro- 
file for the Snapshot and Five Minute Interaction variables is included 
In Appendix A, Also in this appendix is an example of the way changes 
after training are represented using the profile. Finally, in the 
appendix is included a profile assessment sheet.) 

Results and Interpretations 
In broad terms, two general findings for e objective resulted f>om 
this analysis. 

Objective A. To determine the degree of i ^rovenent in selectc-d teacher 
practices after training. 
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As a total group* sample teachers Improved in the recom- 
mended direction on 25 of 31 variables related to five 
educational priorities, 

Por the total group, the degree of teacher improvement 
was estimated to be statistically significant in the 
recommended direction on 9 of 31 variables. These im- 
provements represent a general Increase in Interactive 
on-task learning activities and a decrease in off-task 
social interaction among students. 

To investigate the post-training perfonnance of the 
teachers who showed the greatest need for improvanent 
on the selected variables, 

Teachers with the greatest need showed an average im- 
provement in the recommended direction on 23 of 28 
variables (on three variables, there were two or fewer 
teachers who were beyond the cut-off point). 

Among teachers with the greatest need, statistically sig- 
nificant improvement was shown on 18 of 28 variables. 
In addition to the improvements shown across all teachers, 
these changes included improved classroom management, in- 
creased corrective feedback, and increased use of Quizzes 
and practice drill. 

These general findings are supported through examination of Table 2, and are 
now discussed in turn. Table 3 presents these findings in summary form. 



Finding A,l, Improvement in the Recommended Direction on 25 of 31 Variables 

In general, the average teacher perfonnance Improved slightly for all 
teachers on twenty- five of tliirty-one variables. Variables showing signifi- 
cant improvement are discussed in the next finding. 

We were pleased to see t consistent trend toward overall improvement 
after training. However, in our opinion, the slight average increase reflected 
the degree of demand that teachers placed upon themselves for variables they 
perceived as being at personally satisfactory levels. In the first workshops, 
the expectation voiced by the workshop leader was that teachers would select 
tneir own priorities for improvement. The role of the leader was to support 



Finding A, 1, 



Finding A, 2, 



Objective B- 



Finding B,l, 



Finding B,2, 
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Paired T-Test Results 



12 



CORRECTIVE FEEDBACK 



Group 1 All Teachtrs 



Variable 



N Mean Mean 
Pre Post 



T- One Tail 
Value Probability 



F6 

F7 
F8 



Acknowledge- 25 15.8 16.78 0.67 
ment 



Praise and 
Support 

Probing 
Questions 



25 17.59 18.89 0.85 
25 3.97 4.59 0.60 



F9 providing 25 
Hints 

FiO All Correct- 25 
ive Feedback 

FF7 Positive 25 
Feedback 

FKIO Student 25 
Doesn't Know, 
Adult Probes 



1.68 1.63 -0.15 



14,76 15.41 0.30 



0.27 5.01 5.05 



0.03 0.57 2.79 



INSTRUCTION 

FFl Student Read- 25 7.51 12.96 1.79 
ing Aloud 

FS2 Time Reading 24 4. XI 4.13 0.01 
Aloud 

FS3 Time on 25 17.75 24.09 1.63 

Instruction 

FF2 Instruction, 25 50.56 57.26 1.13 
Subject 

FU All Inter- 25 235.59 253.17 2.17 
actions. 
Subject 

S3 Written 

Assignments 

FS5 Practive 
Drill 



25 28.83 28.10 0.19 
25 3.64 3.41 0.12 



FS6 Test-Taking 



25 



2.85 4.11 0.72 



.256 
.202 

.277 
-,420 
.385 

.000** 
.005** 



.043^ 



,496 



.058 



,135 



.020* 



,427 



,452 



.238 



One 

N Mean Mean T- Tall 
Pre t>ost Value Proba- 
billty 
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20 12.08 14.05 1.33 



19 12.54 15.98 2,24 



1.8S 4.09 1.92 



22 0.98 1.33 1.10 



17 8.51 11.67 3.02 



0.27 6.01 5.0? 



25 0.03 0.57 2.79 



24 5.96 12.01 1.95 



20 1.65 4.68 1.45 



19 16.53 20.04 1.97 



40.78 47.65 0.99 



12 200.47 244.14 4.31 



17 38.09 34.35 0.70 



19 0.00 2.58 99.00 



19 O.OD 3.07 99.00 



.100 



.0X9^ 



.035* 



.143 



.004* 



.005* 



.032* 

.081 

.032* 

.167 

.001** 

.250 

.000** 

.000** 



p<.05 



P coi 
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Variable 



QISCIPLINE 

S4 Time on Social 25 
Interaction 



S5 Students 

Unlnvolved 

F12 All Interac- 
tions, 
Behavior 

F13 Negative 25 
Interactions 

FF5 Social 25 
Coirments 

FF6 Teacher Moni- 25 
toring 
Movement 



F16 Teacher-Con- 
trolled 
Interactions 

FFg Student Re 
marks, 
Assignment 



TABLE 2 - CONT'O 
Group 1 All Teachers 



N Mean 
Pre 



8.57 
25 8.55 
25 ig.3l 



L73 
0.42 
1.33 



Mean T- 

Ppst Val u e 

4.84 2.24 

7.90 0.78 

15.32 0.55 

2.55 -0.58 

5.05 -4.01 
15.45 6.51 



CLA?'.;_HANA6EHENT 

51 Time on Class 25 5.07 

Management 

52 Time on 25 4.42 

Assignments 

F14 All Ir.terac- 25 £5.25 
tions, 
Assignments 

F15 Class Manage- 25 18.^0 
went Inter- 
actions 



q. 33 
5.56 
52.53 



25 34.65 36.53 



GROUP AND CLASS INSTRUCTION 



F2 Adult to 
Group 

F3 Adult to 
Class 

FF3 Group 

Instruct! on, 
(Subject) 

FF4 Class 

Instruction. 
(Subject) 

* P ^ . 05 
** p<.01 



25 15.16 
25 51.01 
25 0.41 



17.00 
45.33 
5.56 



25 2.54 32.45 



One Tail 
Probability 



0.15 
■0.81 
0.36 



15.76 0.55 



0.68 



25 0.58 5.26 -7.2o 



0.56 
-0.27 
3.11 

4.75 



15 



.018* 

.221 

.175 

..170 
-.001** 
.000** 

.430 
-.220 
.362 

.280 

.250 

.000** 



.174 
-.355 
. 003** 

. 000** 
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Group 2 - Teachers with 
Greatest ^eed 

One Tail 

N Mean Mean T- Proba- 
Pre Post Value bi 1 Uv 

20 10.71 5.57 2.64 .008** 

22 5.55 8.36 1.12 .137 

17 26.96 15.04 1.36 .097 



8 4.67 4.12 0.40 .350 

1 1.66 1.00 0.00 1.000 

25 1.33 15.45 6.51 .000** 

10 20.67 10.00 3.75 .003** 

12 5.20 5.10 2.43 .017* 

16 72,56 57.27 1.47 .080 

7 47.71 24.09 1.53 .050* 

15 23.36 31.64 2.86 .007** 

0 0.00 0.00 0.00 i.ooo 



15 



5.54 8.07 1.27 .110 



15 26.78 35.18 1.23 .110 



25 0.41 5.56 3.11 .003** 



25 2.54 32.45 4.75 .000** 



TABLE 3 

SRI Effective Teaching Practices Inservice T»^ining 
Sumnary of Teacher I«prov6Bent 
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Group 1. All T^hers P" OW 2. Teachers in Nee 
Educational Priority and Variables oinction Significance Otrection Significance 



CORRECTIVE FEEDBACK 

Acknowledgement of Correct Answers + + 

Praise and Support of Student Responses + + * 

Probing Questions + + * 

Providing Hints - + 

All COrrectiv* Feedback + + « 

Positive Feedback 

Student Doesn't Know, Adult Probes 
INSTRUCTION 

Stu(tent Reading Aloud + * + * 

Time Reading Aloud ^ ^ 

Time on Instruction + + * 

Instruction, Subject + NA NA 

All Interactions, Subject + * + ♦* 

Written Assigments ^ ^ 

Practice Drill + + 

Test*Taking + + 

DISCIPLINE 

Time on Social Interaction + * + ** 

Students Uninvolved + + 

All Interactions* Behavior + ^ 

Negative Interactions - + 

Social Comnents - ** NA NA 

Teacher Monitoring Movement + ^. ♦* 

CLASSROOM MANAGEMENT 

Time on Classroom Management + ^. 

Time on Assignments - + * 

AH Interactions* Assignments ^ ^ 

Classroom Managements* Interactions ^ ^ ir 

Teacher^COntrolled Interactions + ^. 

Student Remarks „ NA NA 

GROUP and CLASS INSTRUaiON 

Adult to Group, Total Interactions ^ ^ 

Adult to Total Class, Total Interactions - ^ 

Group Instruction + 

Total Class Instruction + ^. 



KEY 

+ = mean improvement in recommended direction 

- * mean group change opposite recommended direction 

* » p<,05 
** * P<,01 



NA * not applicable, n<l 
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them on these Issues. Our experience has led us to recommend a higher 
level of demand on the part of the workshop leader. We coined the 
maxim, "It's not OK to be OK" as a rejoinder to the teachers who argued 
that their performance was in an acceptable range on the S tailings' 
profile. We recommend that workshop leaders set high expectations C^t's 
only OK to be Good!") and consistently probe to encourage teachers to 
demand the most for themselves. To this end, we developed a profile 
assessment sheet (see Appendix A) that is given to teachers after they 
have reviewed their own profiles in light of research recommendations. 
Typically, when the workshop leader communicates his reconmendations to 
each teacher, an intensified level of discussion results concerning the 
priorities each teacher has set. 

The six specific variables showing failure to improve across all 
teachers were: 



pg Providing Hints 



F13 Negative Interactions 



FF5 Social Comments 



S2 Time on Assignments 



The average number of hints 
provided by Ij&achers when students 
did not have the answers remained 
stable. Instead of Increasing. 

The average number of sarcastic 
or demeaning remarks by teachers 
or students increased slightly, 
instead of decreasing. 

The average number of social 
comments exchanged between 
teachers and students increased, 
instead of decreasing. {N,B. 
The initial nuni)er of comments 
was very low, less than 1.) 

The average percent of students 
involved In preparing for their 
assignments Increased slightly. 
Instead of decreasing, (N.B. 
Even with this increase, the 
Cincinnati average remained in 
the recomnrtended range.) 
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FF9 Student Remarks, 
As^^ignment 



The average number of student 
comments about the assignment 
increased significantly from a 
loH initial point, instead of 
decreasing. 



F3 



Adult to Class , 
Total 



The average number of interactions 
between the teacher and the total 
class decreased slightly, instead 
of increasing. 



Finding A. 2. Statistically Significant Improvement on 9 of 31 
Variables 



On nine variables, statistically significant improvement was noted 
across all teachers. In general, these improvements can be summarized 
in two categories: an increase in on-task interactive learning activities 
and a docrease in off-task social intsractlons arrwng students during 
class time. 

Most importantly, the number of verbal interactions between teachers 
and students (FU) Increased significantly (p< .01), This finding means 
that teachers and students spent more time interacting on recommended in- 
structional tasks. It is corroborated by the near significance (p<,058) 
of the increase in Variable FS3, Time on Instruction. Another key part of 
this increase was the significant increase (p<.04) in Reading Aloud {FS2). 
In additions the number of instructional interactions with groups (FF3) or 
the total class (FF4) also increased significantly (p<.01), albeit from 
rather low initial means. Further, adults gave significantly {p< .001) 
more positive feedback to students (FF7) and increased slightly but 
significantly (p< ,01) their tendency to continue to interact with 
students giving the wrong answer. 
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An increase in interactive on-task activities (between teachers 
and students) has been established as an important alterable variable 
in recent work (Stallings, 1980). Interactive on-task activities, 
particularly with groups or the total class, provide teachers with more 
data about their students' current knwledge, and more opportunities to 
correct learning errors before they are reinforced. In addition, 
students tend to stay engaged in their tasks for longer periods of time 
in classrooms where highly interactive instruction occurs. These are 
possible reasons why increased time spent in interactive on*task 
activities is highly correlated with achievement gain. 

Another contributing. factor to this observed increase in time on 
task was the significant decrease (p< -02) in time spent by students in 
off-task social ihieraction with each other. After teacher training, 
the average percent of students engaged in this kind of interaction was 
nearly half its level before training. One possible contributing factor 
to this decrease in Social Interaction was the significant increase 
(p< .001) in Teacher Monitoring Movement about the room (FF6). Again, we 
suspect the reduction in off-task social interaction can be related to 
the vulnerability teachers felt on this issue, leading them to emphasize 
its improvement. Since it is widely accepted that students talking 
during class is not productive, and since teachers knew this variable 
could be easily observed* there was strong incentive to apply the methods 
learned in the workshop to reduce this variable. 

In sum, increased interactive learning and decreased off-task 
social interaction were the most observable outcomes after training. 

er|c i 'J 
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Finding B.l. On the Average. Teachers with the Greatest Need Showe d 
Improvenient Across all Selected Variables 

Of the twenty-five teachers in Group 1» an average of eighteen 
teachers could be classified as In great need on the twenty-eight 
selected variables. This means that (on the average) two-thirds of the 
sample teachers were clearly not correctly implementing each observable 
variable. This was the group defined as having the greatest need. 
Across all twenty-eight variables, the average change after (.raining 
was in the recommended direction. 

There are several possible reasons why this training worked more 
consistently with urban teachers who were demonstrating the greatest 
need for improvement, according to this research framework. The first 
possible reason had to do with teacher motivation. Once a trust level 
was established, teachers whose cJasses were not going as well as they 
would have liked had a higher interest in learning promising approaches, 
especially those proven in classes similar to their own. The motivation 
source tapped by the workshops was the teacher*s desire to do better. 
Second, not only were the training variables easily observable and 
practically defined, they were linked by a point of view about the 
urgency and importance of the teacher's behavior, that went beyond the 
specific recommended behaviors. We suspect it is this point of view and 
its accessibility that draws teachers » and motivates change. For 
improved teaching is more than a matter of improved technique; in part 
it is a question of re-setting personal standards for one's own work. 
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Further, the recommendattons presented to teachers were perceived 
to be research-based, as opposed to authority-based (coming from a prin- 
cipal or supervisor during an appraisal process). Although teachers 
were encouraged to challenge the research and the recommendations, an 
express purpose of the training was to get teachers to reconsider the 
assumptions that underlie their habitual teaching behaviors. This could 
be done best inittally through dialogue wtth the leader and other teachers 
about a somewhat objectified topic— research recommendations recited to a 
teaching profile. Conducted In a group problem-sol vtng mode, the work- 
shops also encouraged teachers to define and solve their own problems, 
using group reccmtmendations and group reinforcement as stimuli for action. 
In short, the greater need of these teachers, the clarity of the variables 
discussed, the power of the point of" view, and the internal organization 
of the training may account for the relative success of Group 2 teachers. 

Finding B.2. Teachers with the Greatest Need Showed Statistically 
Significant Improvement on IB of 28 Variables" 

Teachers with the greatest need for improvanent during preliminary 
observation showed statistically significant improvement on the same 
variables cited in Finding A. 2. However, their growth extended to addi- 
tional variables in three main areas- 

First, teachers having the greatest Initial difficulty improved their 
classroom management skills. The average percent of time teachers were re- 
corded doing classroom management tasks without students during classtime 
(SI) was cut in half after training. Similarly, the percent of students 
recorded in the process of getting organized to learn (S2) and the average 
number of verbal interactions related to classroom management (F15) were 
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also reduced by half. In additioni the number of teacher controlled 
interactions (F16) increased significantly (p<.01). Improvement on 
these variables indicated that teachers learned to design lesson plans 
and organize clarsroOT time more effectively. In a sense^ these 
teachers took a more active leadership stance and were more successful 
at getting students swiftly on to task. 

Second, Group II teachers developed skills at providing positive 
corrective feedback to students. For example, the way that a teacher 
responds to a student who does not know the answer to a question is one 
gauge of that teacher's sophistication as a basic tkills 'riStruci:or. 
Group II teachers increased significantly (p< ,0?!) thr. number of suf- 
portive comments to students (F7). They asked more probing questions 
(F8) and increased significantly {p< .01) the total amount of corrective 
feedback provided (FJO). In short, teachers created a more supportive 
learning environment in which incorrect answers could be hazarded with 
an increased likelihood of receiving helpful teacher responses. 

Third, teachers increased the number of quizzes and the amount of 
practice drill activities in their classes. These recommended activities 
helped low-skilled students learn quickly how they were progressing in 
basic skills subjects. They also increased the teacher's awareness of 
student strengths and weaknesses as a guide for further instruction. In 
sum, the teachers with the greatest need in urban classrooms reduced the 
time spent in their classes on classroom management, increased the posi- 
tive corrective feedback provided to students, and increased the number 
of quizzes and practice drills. In these ways j after training they moved 
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closer to the profile of an effective basic skills instructor that is 
being sketched by recent research. 

Recommendations for Further Research 
The present study presents evidence suggesting that urban tec»chers 
can be trained to improve specific teaching practices correlated with 
achievement using the Stallings Effective Teaching Practice training 
program. While hardly conclusive, these results are promising in two 
ways: they are consistent with previous results related to this train- 
ing program; and they indicate that a second generation of workshop 
leaders can be trained to produce similar outcomes. These are grounds 
for continued dissemination of the training program. 

As this approach is extended* additional information in five key 
areas will be needed. 

K Micro-Analysis of Recommended Variables 

The analysis of teacher behaviors in effective hasic skills class* 
rooms should proceed to investigate the effects of specific instructional 
strategies on achievement. For exa'nple, if the amount of instructional 
time devoted to reading aloud is strongly correlated with reading gains 
by low and medium skilled students at the secondary level, which among the 
many common ways of organizing the reading aloud activity are more produc* 
tive thar, others? To divide up and read the spoken parts of a play may be 
useful under some circumstances* but perhaps not in a basic skills class.* 
Choral reading and radio reading are instructional strategies used more 
often with the poorer readers. Can a selection among these strategies be 



* Of course, there are also a range of ways of reading parts of a play aloud. 
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supported by research? As the example indicates » many of the generally 
recommended instructional activities need to be re-defined and re- 
investigated at the level of specific instructional strategies* if we 
are to clarify with greater precision the recommendations made to basic 
skills teachers. 

2. Calibration of the Recommendations to Various Student Samples 
To date, recommended practices have been found to vary by skill 
level of students. (In other words, recommended variables should be 
implemented with greater or lesser frequency depending upon the cogni* 
tive entry skills of students.) Students differ in many other ways; 
further research with specific target populations may surface recommen- 
dations specific to Black adolescent males, to Hispanics, to adult 
learners, etc. Of course, it is difficult to generalize across most 
manbers of any group, but it is also likely that even qualified cate- 
gories like "low'Skilled secondary reading students" can be usefully 
sub-divided. Findings specific to different sub-groups would provide 
data to answer a major need (identified by Cincinnati teachers) for 
teaching approaches to use in cross-cultural settings (i*e,, White 
teacher/Black class), ror the statistically-derived teacher profile 
(that estimates teacher behavior to three decimal places!) should not 
lead to the mistaken impression that effect ve teaching is more a ques- 
tion of neutral technique than it 1s of human relations and communica- 
tion. For teachers experiencing cross-cultural difficulties, improved 
techniques may be but part of the improvement required* As research 
gradually reveals approaches effective with different student groups, 
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these findings can be usefully added to the training content for urban 
teachers.* 

3v Simplification of the Observation System 

Since the observation system and the profile it produces are at the 
heart of a successful training program* they should not be tampered with 
lightly. But, in Cincinnati, it costs S45/teacher for two sets of pro- 
files (not including six hours of donated labor per teacher, plus travel 
and editing time for observers). It also takes five to seven tull working 
days to train five to se^en observers; and we do not have the specialized 
capability to scan and score the observation booklets locally. The proce- 
dures we follow to have the profiles generated externally are quite manage- 
able and of justifiable expense. But to meaningfully expand the training 
program to the point that it could become a feature of the ongoing develop- 
ment of a sub-'Set of schools requires creating a local capability to pro- 
duce profiles at reduced cost. This could be accomplished if scaled down 
versions of the observation instruments could be developed that reliably 
and validly collected the most important information teachers use off the 
profile. For example, using the existing instruments as the criterion, it 
would be useful to examine the reliability and validity of several optional 
versions of the instrun>ents; 1) more frequent use of the Snapshot alone; 
2} an instrument created by reducing the number of interaction variables and 
coding categories;** 3) a self-assessment questionnaire set up on micro- 
computer that would produce various profiles and recommendations depending 
on teacher responses to a series of diagnostic questions; 4} use of the 



* As an additional direction for research with different student and teacher 
samples* it would be useful to have teacher norms that vary by level (primary 
to seoinr hinh) and by subject (reading* mathematics* etc.). 
** For example, eliminate "who and to whom/' do not distinguish so finely 
between types of questions and responses. 
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existing instruments for one or two classes per teacher^ instead of three. 
Minor modifications of the instruments could well lead to ^ re-design of 
the observation booklets and scoring programs^ so booklets could be scanned 
on a wider variety of scanners and results scored with a program easily 
convertible to many computer systems. The investment of time in this type 
of methodological inquiry would pay dividends for improved portability of 
the training program. 

4. Long-Term Fol low-Up of Teachers and Their Students 
Habitual patterns of teaching behavior have a way of re-asserting 

themselves after the short-term effects of training wear off. Periodic 
refresher sessions, or, better, ongoing problem-solving groups can rein- 
force the new behaviors until they are well-established. Ideally, in a 
school, semi-annual observations and conferences (after completion of the 
initial training) could help keep teachers sharp. Further, studies of 
the long-term results of the training, in terms of both changed teacher 
behavior and accelerated student gains, would be even more convincing 
evidence for this program. 

5. Development of Specialized Workshop Sequences for Teachers 
With Various Heeds 

Around a workshop core including introduction to the research and in- 
terpretation of the profile could be spun many workshop se<|uences geared to 
varying teacher needs. Perhaps the core training could be shortened to two 
sessions, then branch routes could be pursued--by subject-specific groups, 
by teachers needing to regain command of their classes, by first-year 
teachers, by a school staff focusing on basic skills, by alternative school 
teachers, by teachers of gifted or exceptional classes, etc. To confront a 
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possible abuse of the training model, a variant training sequence could 
be developed for use with teachers on appraisal for less than satisfactory 
performance. Assistance could be provided by a neutral third party out- 
side of the tension-filled appralser-appralsee relationship. Development 
of these varying sequences would dramatically diversify the applications 
of this program. 

Conclusion 

^'Successful" inservice training models are not disseminated automati- 
cally or easily, and their effectiveness in new sites often falls short of 
their performance ivi the original sites (Berman and McLaughlin, 1978), This 
study is important because It assesses the way one promising inservice 
training program was implemented with teachers requesting assistance In 
inner-city schools. Preliminary findings from the first year of implementa- 
tion suggest that the Stallings Effective Teaching Practices training pro- 
gram helped teachers having difficulty to improve their perfonnance on key 
variables related to accelerated student achieve[r,ent. If the program con- 
tinues to prove successful, the next level of analysis will be to determine 
which components of the training process actually motivate inner-city teachers 
to reconsider and alter their teaching practices. We suspect that teachers 
with the greatest difficulties need conditions where they are encouraged to 
set more precise and demanding standarJs for their work, and then given the 
support and technical assistance necessary to try out specific new behaviors. 
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Teacher Schoo'i Date 

TEACHER PROFILE ASSESSMENT 

This profile assassattnt Is prepa**e(l as a service to the teacher. It Identifies 
priority reconmndatlons, from the outside perspective of the workshop leader. 
Teachers should consider these recoamndatlons when mtcing their own decisions about 
targets for Improvemnt In their classrooms. 

Educational Variable , Recomnend^ Observed Level Improvement Correcti; 

Priority Nunber and Name^ Doing It ^ Pre Nom Post Target Implement 



Recomnended 


S4 


Tim Reading Aloud 


09 


Tn^ tructlnnal 


M3 


Student Reading Aloud 




Activities 


S6 


Time on Instruction 


20 




F45 


Instruction, Subject 


63 




F94 


Interactions, Subject 


209 




S3 


Silent Reading 


09 




S7 


Total Discussion 


03 




S8 


Practice Drill 


02 




S9 


Written Assignments 


C 1 




SIO 


Test Taking 


02 


Classroom 


S2 


Management, No students 


16 


Management 


S15 


Total Time, Management 


06 




F122 


Management Interactions 


34 




S5 


Making Assignments 


07 




F120 


Interactions, Assignment 


70 




F108 Student Conments 


10 




F137 Student Starts Intractn. 


CD 


Behavior 


$12 


Social Interaction 


04 


Management 


Fi56 


Social Comments 


02 


S13 


Students Unlnvolved 


06 




F91 


Teacher Movement 


17 




F96 


Behavior Interactions 


06 




F102 Negative interactions 


01 


Cor recti ve 


F61 


Acknowledgnient 


17 


Feedback 


F71 


Praise and Support 


19 




F73 


Probing Questions 


03 




F75 


Providing Hints 


03 




F76 


All Feedback 


14 




F99 


Positive Interactions 


04 




F136 Adult/Oiff. Student 


27 




F17 


Adult Direct Question 


41 


Individual/ 


F5 


Adult to Ind. Student 


89 


Group/ 


F6 


Adult to Group 


13 


Class 


F48 


Group Instruction 


08 




F7 


Adult to Class 


44 




F49 


Total Class Instruction 


33 



iriebles nimbered "S" reported In % of observed time; those numbered "F" reported in 
t&Miis of frequency of occurence per class period. 

2 

Priority variables from leader's perspective marked with 
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